B-orbits of 2-nilpotent matrices and 
generalizations 



Magdalena Boos and Markus Reineke 
Fachbereich C - Mathematik 
Bergische Universitat Wuppertal 
D - 42097 Wuppertal 
boos@math.uni-wuppertal.de, reineke@math.uni-wuppertal.de 



Abstract 

The orbits of the group B n of upper-triangular matrices acting on 
2-nilpotent complex matrices via conjugation are classified via oriented 
link patterns, generalizing A. Melnikov's classification of the _B n -orbits on 
upper-triangular such matrices. The orbit closures as well as the "build- 
ing blocks" of minimal degenerations of orbits are described. The classi- 
fication uses the theory of representations of finite-dimensional algebras. 
Furthermore, we initiate the study of the _B n -orbits on arbitrary nilpotent 
matrices. 



1 Introduction 

The study of adjoint actions and variants thereof, and in particular the classi- 
fication of orbits for such actions and the description of the orbit closures, are 
a common theme in Lie representation theory. The archetypical example is the 
Jordan-Gerstenhaber theory for the conjugacy classes of complex nxn-matrices. 

A more recent case is A. Melnikov's study of the action of the Borel subgroup 
B n acting on upper-triangular 2-nilpotent matrices via conjugation jSHH]- The 
orbits and their closures are described there combinatorially in terms of so-called 
link patterns, which we will recapitulate in section [2~T] 

Our aim in this paper is to generalize the work of A. Melnikov by extending the 
variety of upper-triangular 2-nilpotent matrices to all 2-nilpotent matrices. The 
basic setup to reach this goal is a translation of the classification problem to a 
problem in representation theory of finite-dimensional algebras. More precisely, 
this translation yields a bijection between the orbits and the isomorphism classes 



of certain representations of a specific finite-dimensional algebra, see section 3.1 



After a brief summary of methods from the representation theory of algebras 



(see, for example, [T]) in section 2.2 we are able to calculate all indecomposable 



representations using Auslander-Reiten theory [5] in section 3.2 and to classify 



1 



the required representations. This gives a combinatorial classification in terms 
of oriented link patterns in section |3.3| 

Since several results on orbit closures for representations of finite-dimensional 
algebras are available through work of G. Zwara |101lll| . we can also character- 
ize the orbit closures of 2-nilpotent matrices in section [4j 

Finally, we study the conjugation action of upper-triangular matrices on arbi- 
trary nilpotent matrices. We provide a generic normal form for the orbits of 
this action in section |5.1| and construct a large class of semiinvariants in section 
1521 

Acknowledgments: The authors would like to thank K. Bongartz and A. 
Mclnikov for valuable discussions concerning the methods and results of this 
work. 

2 The basic setup 

In this section, we fix some notation and collect information about the afore- 
mentioned group action. In addition, we summarize material from the repre- 
sentation theory of finite-dimensional algebras. 

Let k = C be the field of complex numbers. We denote by B n C GL„(£;) the 
Borel subgroup of upper-triangular matrices, by Af n C M nxn (k) the variety of 
nilpotent n x n-matrices, and by An the closed subvariety of 2-nilpotent such 
matrices. Obviously, Gh n (k) and B n act on Af n and on A^ via conjugation. 

In case of the action of GL„(£;) on Af n , the classical Jordan-Gerstenhaber the- 
ory gives a complete classification of the orbits and their closures in terms of 
partitions (or, equivalently, Young diagrams). 

Our aim is to classify the orbits Oa of 2-nilpotent matrices A <E Afn under the 
action of B n . Such a classification will be given in terms of oriented link pat- 
terns; these are oriented graphs on the set of vertices {1, . . . , n} such that every 
vertex is incident with at most one arrow. This is followed by a description 
of the orbit closures, by giving a necessary and sufficient condition to decide 
whether one orbit is contained in the closure of another, and by a method to 
construct all orbits contained in a given orbit closure. These descriptions are 
also given in terms of oriented link patterns. 

2.1 Results of A. Melnikov 

The group B n also acts on n„ C Af n , the space of all upper-triangular matrices in 

(2) (2} 

Af n , and on Tin = tl„ H An • The orbits and their closures for the latter action 
are described by A. Melnikov in [8, 9 . Since these results will be generalized in 
the following, we describe them in more detail. 

(2) 

Let Sn be the set of involutions in the symmetric group S n in n letters. An 

(2) 

element a of Sn is represented by a so-called link pattern, an unoriented graph 
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with vertices {1, . . . , n} and an edge between i and j if a(i) = j. For example, 
the involution (1,2)(3, 5) € Ss(k) corresponds to the link pattern 



For a £ S { n\ define N a £ A^ 2) by 

J 1 if i < j and cr(i) = j, 
1 tlJ,J \ otherwise, 

and denote by B a — B n ■ N a the £?„-orbit of N a . 

("2") 

Theorem 2.1. Every orbit of B n in \\n is of the form B a for a unique 
The next step is to look at the (Zariski-)closures of the orbits B a . 

(21 (2) 

For 1 < % < j < n, consider the canonical projection 7Tjj : n« — > \Vj_ i+1 

(2) 

deleting the first i — 1 and the last n — j columns and rows of a matrix in n„ . 

(2) 

Define the rank matrix R u of u £ by 

f rank(7r i)J -(u)) if i < j; 
[^u)i,j - | o otherwise. 

The rank matrix i? u is S n -invariant, and we denote = Rn„ for cr e ■ We 
define a partial ordering on the set of rank matrices by R a > =4 Ra if (Ra')i.j < 

(2) 

(Ra)i,j for all i and j, inducing a partial ordering on S„ by cr ^ a if ^ 

Theorem 2.2. JP^ T/ie or&rf closure of B a is given by B a = \} a r^ a B a : . More- 
over, the entry {R a )i_j of the rank matrix equals the number of edges with end 
points ei and e2 such that i < e\,e2 < j in the link pattern of a. 

(2) 

The theorem thus gives a combinatorial characterization of the _B„-orbits in n„ 
and their orbit closures in terms of link patterns. 



2.2 Representations of algebras 

As we make key use of results from the representation theory of finite-dimen- 
sional algebras for the study of the action of B n on Nn\ we now recall the 
basic setup of this theory and refer to [T] and [2] for a thorough treatment. Let 
Q be a finite quiver, that is, a directed graph Q = (Qo, Qi,s,t) consisting of 
a finite set of vertices Qo an d a finite set of arrows Qi, whose elements are 
written as a : s(a) — > t(a); the vertices s(a) and t{a) are called the source and 
the target of a, respectively. A path in Q is a sequence of arrows lo — a s . . . a\ 
such that tiptk) = s(ak+i) for all k = 1, . . . , s — 1; we formally include a path 
Sj of length zero for each i £ Qo starting and ending in i. We have an obvious 
notion of concatenation louj' of paths u = a s . . . Oi\ and u)' = fit • ■ ■ Pi such that 
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t{l3 t ) = s{a x ). 



The path algebra kQ is defined as the k- vector space with basis consisting of 
all paths in Q, and with multiplication 



The radical rad(fcQ) is defined as the (two-sided) ideal generated by paths of pos- 
itive length. An ideal I of kQ is called admissible if rad(fcQ) s did rad(fcQ) 2 
for some s. 

The key feature of such pairs (Q, I) consisting of a quiver Q and an admissible 
ideal I d kQ is the following: every finite-dimensional fc-algebra A is Morita- 
equivalent to an algebra of the form kQ/I, in the sense that their categories of 
finite-dimensional fc-representations are (fc-linearly) equivalent. 

A finite-dimensional fc-representation M of Q consists of a tuple of fc-vector 
spaces Mi for i & Qo, and a tuple of fc-linear maps M a : Mi — > Mj indexed 
by the arrows a : i — > j in Q\. A morphism of two such representations 
M = ((Mi) ieQa , (M a ) aeQl ) and N = ((Ni) ieQo , (N a ) aeQl ) consists of a tuple 
of fc-linear maps (/j : Mi — > Ni)ieQ such that 



For a representation M and a path to in Q as above, we denote M u = M ag • . . . • 
M ai . We call M bound by / if J2u X ^ M ^ = whenever J2u> e L 
The abelian fc-linear category of all representations of Q bound by I is denoted 
by rep fe (<2, /); it is equivalent to the category of finite-dimensional representa- 
tions of the algebra kQ/I. We have thus found a "linear algebra model" for the 
category of finite-dimensional representations of an arbitrary finite-dimensional 
fc-algebra A. 

We define the dimension vector dim M e NQ of M by ( dim M),- = dim^ Mj 
for i e Q . For a fixed dimension vector d € NQ , we consider the affine 
space Rd(Q) = ® a . i _ ) jHomi(i;' li ,i; li i); its points naturally correspond to rep- 
resentations M of Q of dimension vector d with Mj = fc di for i G Qo- Via 
this correspondence, the set of such representations bound by I corresponds 
to a closed subvariety Rd(Q,I) d Rd{Q)- It is obvious that the algebraic 
group Ghd = IlieQo GLfc(fc di ) ac ts on Rd(Q) and on Rd(Q,I) via base change 
(gi)i ■ (M a ) a = (g j M a gT~ 1 ) a:i ->j. By definition, the GL^-orbits O m of this ac- 
tion naturally correspond to the isomorphism classes of representations M in 
rep fe (Q, I) of dimension vector d. 

By the Krull-Schmidt theorem, every representation in iep k (Q,I) is isomorphic 
to a direct sum of indecomposables, unique up to isomorphisms and permuta- 
tions. Thus, knowing the isomorphism classes of indecomposable representations 
in rep fc (Q, /) and their dimension vectors, we can classify the orbits of GL^ in 




ujuj' if t(f3 t ) = s(a 1 ), 
otherwise. 



fjM a = N a fi for all a : i ->• j in Qx. 



Rd{Q,I). 
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For certain classes of finite-dimensional algebras, a convenient tool for the clas- 
sification of the indecomposable representations is the Auslander-Reiten quiver 
r(Q, J) of kQ/I. Its vertices [X] are given by the isomorphism classes of inde- 
composable representations of kQ/I; the arrows between two such vertices [X] 
and [Y] are parametrized by a basis of the space of so-called irreducible maps 
/ : X —> Y. Several standard techniques are available for the calculation of 
r(Q, 7), see for example |T] and [7]. We will illustrate one of these techniques, 
namely the use of covering quivers, in subsection 3.2 in a situation relevant for 
our setup. 



3 Classification of orbits 

3.1 Translation to a representation-theoretic problem 

Our aim in this section is to translate the classification problem for the action of 

(2) 

B n on An into a representation-theoretic one. The following is a well-known 
fact on associated fibre bundles: 

Theorem 3.1. Let G be an algebraic group, let X and Y be G— varieties, and 
let 7r : X — > Y be a G-equivariant morphism. Assume that Y is a single G- 
orbit, Y = Gy . Define H := Iso G (y ) = {g € G | g ■ y = yo} and F := 
7T _1 (yo)- Then X is isomorphic to the associated fibre bundle G x H F, and the 
embedding <j> : F c — >■ X induces a bijection between H-orbits in F and G-orbits 
in X preserving orbit closures. 

We consider the following quiver, denoted by Q from now on, 

OL\ OL2 OLn-2 Otn—l 

Q : • > • > • • • • • > • » • a 

12 3 n-1 n-1 n 



together with the ideal I c kQ generated by the path a 2 . We consider the 
full subcategory rep)J 1J (Q, I) of rep fe (Q, I) consisting of representations M for 
which the linear maps M ai , . . . , M oln _ 1 are injective. Corresponding to this 
subcategory, we have an open subset i?™ J (Q,I) C Rd(Q,I)-, which is stable 
under the GL^-action. We consider the dimension vector d :— (1,2, ... ,n) £ 
N™. 

Lemma 3.2. There exists a closure-preserving bijection between the set of B n - 

( 2} in" 

orbits ill Mn an d the set of GL^- orbits in R 1 ^ 3 (Q , I) . 

Proof. Consider the subquiver Q of Q with Q = Q and Qi = Qi \ {a}. We 
have a natural GL^-equivariant projection it : R 1 ^ 1 (Q,I) — > R™ 3 ( Q) . The variety 
R^iQ) consists of tuples of injective maps, thus the action of GL^ on Rd(Q) is 
easily seen to be transitive. Namely, i?^ nj (<2) is the orbit of the representation 

y := k ^ k 2 ^ ■ ■ ■ ^ fc"- 1 ^ k n , 



5 



with a.i being the canonical embedding from k l to k l+1 . The stabilizer H of yo 
is isomorphic to B n , and the fibre of tt over yo is isomorphic to Aft . Thus, 
R^iQ,!) is isomorphic to the associated fibre bundle GL^ x Bn Af,^ , yielding 
the claimed bijection. □ 

3.2 Classification of indecomposables in rep fe (Q, I) 

By the results of the previous section, it suffices to classify the indecomposable 
representations in rep fc (Q, /) to obtain a classification of the orbits of B n in 
Nn^ . We compute the Auslander-Reiten quiver r of kQ/I using covering theory, 
which is described in [7J as mentioned before. We consider the (infinite) quiver 
Q given by 

I 

• > • > • • • • • > • > • 

Q : • > • > • • ■ • • > • > • 

• » • > • • • • • > • > • 

1 2 3 n-2 n-1 n 

with the ideal / generated by all paths ai+ia^, and the quiver Q' given by 

Q' : • > • > • • • • • > • > • 

• > • > • • • • • > • > • 

1 2 3 n-2 n-1 n 

The quiver Q carries a natural action of the group Z by shifting the rows, 
such that Q/Z = Q. Moreover, Q' naturally embeds into Q, such that the 
composition of this inclusion with the projection Q — > Q is surjective. By results 
of covering theory [7], we have corresponding maps of the Auslander-Reiten 
quivers, namely an embedding T(Q') — > T(Q,I) and a quotient T(Q,I) —> 
r(Q,I), such that the composition is surjective. Since Q' is nothing else than a 
Dynkin quiver of type A^n . it is routine to calculate its Auslander-Reiten quiver 
(see [1]), and we derive the Auslander-Reiten quiver T = /) just by making 
the identifications resulting from the action of Z, which can be read off from 
the dimension vectors of indecomposable representations. More examples and 
details concerning the calculation of Auslander-Reiten quivers using covering 
theory can also be found in [7J. 



G 



We finally arrive at the picture (the marked regions have to be identified) given 
in figure [T] 

We define the following representations Uij for 1 < i,j < n, Vj for 1 < i < n 
and Wi.j for 1 < i < j < n in rep k (Q,I) (graphically represented by dots for 
basis elements and arrows for a map sending one basis element to another one): 

Liij for 1 < j < i < n: 

^ ~ , id id T ei , o id id , 9 

-> ••• -> -> fc — ■> ••• — ■> fc — > fc 2 — ■> ••• — ■> rpa 
• ->• ->• • ->• ••• ->• • 

j « n ) 



W^j for 1 < i < j ' < n: 



• -> • • • -» • 



Vi for 1 < i < n: 



^> 





— ► 











W»,j for 1 < i < j < n: 



°> 









— >■ 



o 
n 



Here we denote ei= (^Qj> e 2=^2y anc ^ a = 

Theorem 3.3. The representations Uij, Vi and Wij /orm a system of rep- 
resentatives of the indecomposable objects in rep fc (Q, 7). The representations 
Ui j and Vi form a system of representatives of the indecomposable objects in 

re P L nj (Q,I) 

Proof. The endomorphism rings of these representations are easily computed to 
be 

End(Uij) = k for i > j, End(W i)3 -) = k[x]/(x 2 ) for i < j, 
End(Vi) = fc, End(W lJ ) = fc, 
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thus they are indecomposable. Their dimension vectors are 

(0 ... 01 ... 12 ... 2), (0 01 1) and (0 01 10 0), 

respectively. These are precisely the dimension vectors appearing in T(Q, I), 
thus we have found all indecomposables. It is clear from the definition that the 
indecomposable representations belonging to rep)° J (Q, I) are the Wjj and the 
V t . ' ■ , ^ 

3.3 Classification of £? n -orbits in 

Our next aim is to parametrize the isomorphism classes of representations in 
rep), nj (<2, /) of dimension vector d. As mentioned before, the Krull-Schmidt 
theorem states that every representation can be decomposed into a direct sum 
of indecomposables in an essentially unique way. 

Theorem 3.4. The isomorphism classes M in rep^ (Q, 7) of dimension vector 
d are in natural bijection to 

1. n x n-matrices A — (rrii_j)ij with entries or 1, such that TO i,i + 

m j,i _• 1 f or all i = 1, . . . , n, 

2. oriented link patterns on {1, ...,n}, that is, oriented graphs on the set 
{1, . . . , n} such that every vertex is incident with at most one arrow. 

Moreover, if an isomorphism class M corresponds to a matrix A under this 
bijection, the orbit Om C i?™ J (Q,/) and the orbit Oa € Nn correspond to 
each other via the bijection of Lemma\3.2\ 



Proof. Let M be a representation in rep fe (Q, I) of dimension vector d, so 

n n 

w 0C 0v: 



for some multiplicities m.i^ , n, e N by Theorem 3.3 Since dim M = (1,2, ... ,n), 
we simply need to calculate all tuples (m^j,^) such that 

n n 

rrii j dimU ; j + n.t dim V, = d = (1,2, ... ,n). 

i,j = l i = l 

Applying the automorphism S of Z n defined by 

S(di,d 2 , ...,d n ) = (di,d 2 - di,d 3 -d 2 ,...,d n - d n -i), 
this condition is equivalent to 

n n 

^ m i j 6( dimU l j) + n^( dimV ») = (1, 1, . . . , 1, 1). 
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If we fix i e {1, . . . , n}, this condition states that 

n n 

We can extract an oriented graph on the set of vertices {1, . . . , n} from (mij)ij 
as follows: for all 1 < i,j < n, we have an arrow from j to i if niij = 1. The 
conditions on (?rii,j)i,j ensure that this graph is in fact an oriented link pattern. 
The matrix {mij)ij is obviously 2-nilpotent. 

The decomposition of M into indecomposables can be visualized as follows. 




The arrows in the rightmost column of the diagram allow us to read off the 
indecomposable direct summands of M. Namely, Ik.j is a direct summand 
of M if and only if there is an arrow j — > i. If there is no arrow at k, the 
indecomposable Vk is a direct summand of M. 

Shortening the above picture to the rightmost column, M corresponds to an 
oriented link pattern: 




□ 

For a given matrix A G , we would like to decide to which oriented link 
pattern it corresponds. Define Ui = (e\, . . . , e^), the span of the first i coordinate 
vectors in k n , and define a matrix D A = (dfj)i.j by setting dfj := dim([/j n 
A(Uj)) (we formally define dfj = for i = or j = 0). The matrix D A 

is obviously an invariant for the B„-action on It is easy to extract an 

oriented link pattern from D A as follows: 

Lemma 3.5. The matrix A belongs to the orbit of a matrix (mij)ij as above if 
and only if dfj = J2i><i ; j<<j m i',j' ° r , conversely, m^j = dfj - df_ ltj - d A j _ 1 + 
d A _ 1 j_ 1 for all 1 < i,j < n. 
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Proof. By B„-invariance, we just have to compute D A for A — (mij)ij as in the 
previous theorem. We have e& G Ui H A(Uj) if and only k < i and there exists 
I < j such that m,k,i — 1 or, equivalently, such that there exists an arrow I — > k 
in the corresponding oriented link pattern. Since both Ui and A(Uj) are spanned 
by coordinate vectors e^, we thus have df^ = dim(f/j C\A{Uj)) = ^2 k<i ;<j mk,l- 
The second formula follows. □ 

We can also rederive Theorem |2.1| of A. Melnikov: every B n — orbit of an upper- 
triangular 2-nilpotent matrix corresponds to the orbit of a representation in 
rep), nj (<2, /) of dimension vector d which does not contain Uij for i > j as a 
direct summand. In this case, the corresponding link pattern consists of arrows 
pointing in the same direction. We can thus delete the orientation and arrive 
at a link pattern as in [5] . 

Remark: Our method is easily generalized to obtain a classification of orbits for 
a more general group action: let V C GL„ be the parabolic subgroup consisting 
of block-upper triangular matrices with block-sizes . . . Then V acts on 
Af^ by conjugation, and the same reasoning as above yields a bijection between 
■p-orbits in Afn^ and isomorphism classes of representations in rep™\Q, I) of 
dimension vector (b\, b\ + 62, . . . , J2i=i Using the analysis of this section, 
the P-orbits in Nn^ correspond bijectively to matrices {m,i such that 

rm,j + X! m J>« - bl 
j j 

for all i = l,...,fc. Consequently, they correspond bijectively to "enhanced 
oriented link patterns of type (61, ... , &&)", namely, to oriented graphs on the 
set {1, . . . , k} such that the vertex i is incident with at most bi arrows for all i. 



4 Orbit closures 

After classifying the orbits via oriented link patterns, we describe the corre- 
sponding orbit closures. Again, we will solve this problem using results about 
the geometry of representations of algebras. Two theorems of G. Zwara are the 
key to calculating these orbit closures, see [TO] and [TT] for more details. 



4.1 A criterion for degenerations 

Let M and M' be two representations in rep fc (Q, /) of the same dimension vector 
d. We say that M degenerates to M' if Ow C Cm in Rd(Q,I), which will be 



denoted by M <dcg M'. Since the correspondence of Lemma 3.2 preserves orbit 
closure relations, we know that M <dcg M' if and only if the corresponding 
2-nilpotent matrices, denoted by A = (mij)i.j and A' — {m^^ij, respectively, 

fulfill O a , cOAmAfl 2) . 
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Theorem 4.1. (Zwara) Suppose an algebra kQ/I is representation- finite, that 
is, kQ/I admits only finitely many isomorphism classes of indecomposable rep- 
resentations. Let M and M' be two finite- dimensional representations of kQ/I 
of the same dimension vector. 

Then M < dcg M' if and only if dim k Hom(U, M) < dim k Hom(U, M') for every 
representation U of kQ/I. 

To simplify notation, we set [U, V] :— dim^ Hom([/, V) for two representations U 
and V. Since the dimension of a homomorphism space is additive with respect 
to direct sums, we only have to consider the inequality [U, M] < [U, M'] for 
indecomposable representations U to characterize a degeneration M <d cg M' . 
Furthermore, since [Wij,M] = for all representations M in rep' fe nj (Q, /) by a 
direct calculation, we can restrict these indecomposables U to those of type liij 
and Vi of the previous section. 

We can easily calculate the dimensions of homomorphism spaces between these 
indecomposable representations. 

Lemma 4.2. For k, I £ {1, . . . , n} we have 

• [Vk,Vi] = Si< k , 

• [Vfe,W»,j] = Si<k, 

• [Z4,j, Vj] = Si<i, 

• ^Ak,iMi,j\ = 5i<i + 5j<i ■ Si<k, 

t f f 1> if x < y; 

where d x < v := < „ : 

- y \ 0, otherwise. 

For a representation M in rep™ J (Q, I) of dimension vector d (or equivalently, for 
the corresponding 2-nilpotent matrix A), consider the corresponding oriented 
link pattern. Define p^f as the number of vertices to the left of k which are not 
incident with an arrow, plus the number of arrows whose target vertex is to the 
left of k. Define q k M l as pf 1 plus the number of arrows whose source vertex lies 
to the left of / and whose target vertex lies to the left of k. 

Theorem 4.3. We have M <d og M' (or equivalently, O a< C Oa in the notation 
above) if and only if pff < pff and q k xl l < qjf t for all k, I — 1, ... ,n. 

Proof. Given two representations M and M' , we write 

n n n n 

M=©C J ®0 ^ and M' = vf . 

i,j = l i—1 — 1 i—1 

For an indecomposable U, the condition [{/, M] < [U, M f ] is then equivalent to 

n n n n 

i,j — l i—1 ijj=l i—1 



n 



Using the dimensions of homomorphism spaces between indecomposable repre- 
sentations stated in the previous lemma, we calculate 



j<fc;j i<k 

and 

q Kl (M)=pf+ 

i<k;j<l 

and the condition [U, M] < [U, M'\ is equivalent to the conditions p^ < p^f 
and q^\ < q^ 1 l for all k, I — 1, . . . , n. The claimed interpretation of these values 
p^ 1 and qjf t in terms of oriented link patterns follows from Theorem 



3.4 



□ 



4.2 Minimal degenerations 

As a next step, we develop a combinatorial method to produce all degenerations 
of a given representation M in rep™ J (Q, /) of dimension vector d out of its 
oriented link pattern. It is sufficient to construct all minimal degenerations, 
that is, degenerations M <dcg M' such that if M <dcg L <deg M' , then M = L 
or M' = L. Minimal degenerations are denoted by M < m dcg M'. 

In [11 , G. Zwara describes all minimal degenerations; the result is stated here 
in a generality sufficient for our purposes. Denote by < ex t the transitive closure 
of the relation on representations given by M < M' if there exists a short exact 
sequence -> M[ M -> M' 2 -> such that M' = M[ (B M' 2 . 

Theorem 4.4. Let M and M' be representations in rep)! 1J (Q, 7). 
If M < m deg M' ' , then one of the following holds: 

1. M < ext M' 

2. There are representations W, M, M' in rep fe (Q, I) such that 

(a) M = WG)M 

(b) M> ^W®M' 

(c) M < mdcg M> 

(d) M' is indecomposable. 

Combining this theorem with the technique of Theorem 4] , we obtain a char- 
acterization of minimal disjoint degenerations, that is, minimal degenerations 
M < mdcg M' such that M and M' do not share a common direct summand: 

Corollary 4.5. Let M < m dcg M' be a minimal disjoint degeneration as be- 
fore. Then either M' is indecomposable or M' = U © V , where U and V are 
indecompo sables and there exists an exact sequence O—tU—tM—tV—tOor 
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Thus we see that all minimal degenerations are of the form W ® M < m deg 
W © M' , where M and M' are as in the corollary, thus M' involves at most two 
indecomposable direct summands. Translating this to the language of oriented 
link patterns using Theorem |3.4| we have "localized" the problem to the consid- 
eration of at most four vertices of an oriented link pattern. In this local case, 
we can apply Theorem |4.3| and easily work out all minimal degenerations. 



Theorem 4.6. Every minimal degeneration is of the form given in one of the 
following diagrams showing parts of the degeneration posets in terms of oriented 
link patterns. We assume that a < b (resp. a < b < c, resp. a < b < c < d) are 
vertices of an oriented link pattern, and only indicate the changes to the arrows 
incident with one of these vertices; all other arrows are left unchanged. 

r~x ' AA 

• • • • • 

a b a b c 



A 



• • • 

a b c 



A 




• • • 

a b c 



A 



• • • 

a b c 



A 



• • • 

a b c 
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abed 

Remark: Note that, although every minimal degeneration is of the form W © 
M < m deg W © M' as above, the choice of W is not arbitrary, that is, addition 
of an arbitrary W might lead to a non-minimal degeneration. The precise 
conditions on W neccessary for this degeneration to be minimal will be described 
in as a consequence, it will be shown in |4J that all minimal degenerations 
are of codimension 1 . 



We have thus obtained a constructive way of describing an orbit closure O a of 
a 2-nilpotent matrix A in terms of its corresponding link pattern: by repeated 
application of the local changes to the arrows as in the theorem, we produce a 
list of all link patterns corresponding to matrices A <G Nn such that Oa 1 C Oa 
(although this list will contain repetitions due to non- minimal degenerations). 



5 5 n -orbits in arbitrary nilpotent matrices 

In this section, we consider the action of B n on Af n by conjugation in general 
(for the analogous problem of the action of B n on n„, see [3]). 

The starting point is the following observation (see [5]): 

Example: Consider the action of B3 on A/3 via conjugation. Then the matrices 
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1 
A 1 



for A G k are pairwise non-conjugate. Furthermore, on the open 



set U C A/3 of nilpotent matrices A 



a b c 
d e f 
9 h i 

the map U — > P 1 given by A M> (g : d/i — eg) is surjective and i? 3 -invariant. 



where g ^ or dh 7^ eg, 



We generalize some aspects of this example to arbitrary n. 
5.1 Generic normal form 

It is appropriate to reformulate the problem as follows: we consider the action of 
GL(V) on pairs (F*,<p) consisting of a complete flag = F C F\ C . . . C F n — 
V and a nilpotent operator ip G End(V) of an n-dimensional fc-vector space V. 
Then the orbits of this action are precisely the orbits of B n in J\f n since the 
variety of complete flags is isomorphic to the homogeneous space GL„ /B n . 

Theorem 5.1. The following properties of a pair (F*,tp) consisting of a com- 
plete flag and a nilpotent operator of an n-dimensional k-vector space V are 
equivalent: 

1. dimip n ~ k (F k ) = k for all k = 1, . . . ,n - 1, 

2. d\m((p n ~ k (Fk) + Fk)/Fk = k for all k = 1, . . . , n — 1, or, equivalently, all 
induced maps ip : F k — > V/F n -k are invertible, 

3. there exists a unique basis Vi, . . . ,v n of V such that 

(a) F k = (vi, ...,Vk) for all k = 0, . . . ,n, 

(b) ip(v k ) = v k+1 mod (v k +2, ■ ■ ■ , v n ) for all k = 1, . . . , n. 

Proof. Obviously, the second property implies the first. We show that the third 
property implies the second one; so assume there exists a basis vi,...,v n with 
the properties (a) and (b). By an easy induction, we have 

tp k (vi) = v k+ i mod (vk+1+1, • • • ,t> n ) 

for all k + I < n, and (f k (vi) = if k + I > n. We thus have 

<p n - k {F k ) - (^- fe («i), . . . , V n - k M = (v n - k+ i, ...,v n ), 

and the second property follows since F n _ k = (v\, . . . , v n - k ). 

Conversely, assume that dim ip n ~ k (F k ) = k for all k. In particular, we have 
ip> n - k {V) — tp n ~ k (F k ), and thus dim tp n ~ k (V) = k and dimKer^™^) = n — k 
for all k. We choose an arbitrary basis wi,...,w n of V which is adapted to 
F*, that is, such that F k — (w\, . . . ,w k ) for all k. Then, for all k, the elements 
(p n ~ k (wi), . . . , ip n ~ k (w k ) generate the /c-dimensional space <p n ~ k (F k ), thus they 
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form a basis of this space. We can thus write the element ip n 1 (wi) € ip n k (Fk) 
uniquely as 

k 

v n - 1 (w 1 ) = J2h,^ n - k M 

i=l 

and we define 

k 



Vk = ^2h, 



i=i 

for all k. Note that the elements Vk do not depend on the choice of basis elements 
tui, ...,w n . We have 6 fc , fe ^ 0: otherwise ^Vi) = J2i<k b k ,i<f n ~ k (wi), and 
application of ip yields = '%2i < kbk,i i P n ~^ k ~ 1 \'Wi) an d thus bk,i = for all i 
by linear independence of the elements </3 n_ ( fe_1 )(wj). Then < f 5™ _1 (w 1 ) = 0, a 
contradiction. Since the elements uifc form a basis and the bk,k are non-zero, the 
elements Vk form a basis, too, which is again adapted to F*. 

We have 

k 

»=1 

by definition. For fc + Z > n, we thus have 

<p k ( Vl ) = i p k+l - n (i P n - l (v l )) = v k+l - n {v n -\wi)) = 0. 

It follows that Vk+i, ■ ■ ■ ,v n belong to Ker(ip n ~ k ), thus they form a basis of this 
space for dimension reasons. It also follows that (p n ~ k (vi), . . . , f n ~ k (vk) form a 
basis of ip n ~ k {V). 

Writing <p k (vi) = Ym=\ c k,l,i v i, we a Pply p n ~ k ~ l and calculate 

<P n - k -\v k+l ) = v n = ip n -\vfi =Y, c U,W n ~ k ~\vi) 

i 

= c k ,i, k +l<P n ~ k ~ l (vk+l) + c k,l,i<P n ~ k ~ l (vi), 

i<k+l 

and thus Ck,i,k+i = 1 an d Ck,i,i = for all i < k + I by linear independence of 
ip n ~ k ~ l (vi), . . . ,(p n ~ k ~ l (v k +i). We thus have 

ip k (vi) = v k+ i + Y Ck,i,iVi 

i>k+l 

for all k + I < n, and, in particular, 

i>k+l 

for all k. The basis vi,...,v n thus has the claimed properties. □ 

For < a, b < n and a matrix A e N n , define A( a ^ as the submatrix formed 
by the last a rows and the first b columns of A. 
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Corollary 5.2. The following conditions on a matrix A € Af n are equivalent: 

1. for k = 1, . . . ,n — 1, the first k columns of A n ~ k are linearly independent, 

2. for k = 1, . . . , n — 1, the minor det((A n ~ k ) (k,k)) * s non-zero, 

3. A is B n - conjugate to a unique matrix H such that Hij = for i < j and 
Hi + \ t i = 1 for all i = 1, . . . , n — 1. 

Proof. We apply the previous theorem to the vector space V = k™ with coor- 
dinate basis ei, . . . , e n , the standard flag defined by Fk — (ex, . . . , e^) and the 
endomorphism ifi given by multiplication by A. The first property of the theorem 
immediately translates into linear independence of column vectors, whereas the 
second property translates to the non- vanishing of minors. The basis v\, . . . ,v n 
of the theorem yields an upper-triangular base change matrix, and representing 
A with respect to this basis yields the desired i?„-conjugate H . 

□ 

The conditions of Corollary |5 . 2| define an open subset oiN n \ we have thus found 
a generic normal form for nilpotent matrices up to i?„-conjugacy. 

5.2 Semiinvariants 

We construct a class of determinantal i?„-semiinvariants on Af n , that is, regular 
functions D on Af n such that D(gAg~ 1 ) — x(g)D(A) for all g € B n and A E Af n ; 
here % is a character on B n called the weight of D. For i = 1, . . . , n, we denote 
by uji : B n — > G m the character defined by Uii(g) = g%,i\ the Ui form a basis for 
the group of characters of B n . 

Fix non-negative integers ax, . . . , a s , b±, . . . , bt such that ax + . . . + a s — bx + 
. . . + b t =: k < n. Moreover, fix polynomials Pij(x) € k[x] for i = 1, . . . , s 
and j = 1, and denote the datum ((cti)i, {bj)j, (P-i.j)i.j) by P. For all 

such i and j, consider the x 6j-submatrices Pij(A)( aiibj j as defined in the 
previous section, and form the block matrix A p = (Pi,j(A)( a . b .< ) )i.j; this is a 
k x /c-matrix. 

Proposition 5.3. For every datum P as above, the function associating to a 
matrix A 6 Af n the determinant det(A p ) defines a B n -semiinvariant regular 
function D p of weight '^2 li {ijJ ai + • • • + w„) — + • • • + ^b,) on Af n . 

Proof. For g € B n and 1 < a, b < n. denote by g(> a ) G B a (resp. by <?(<(,) G Bfc) 
the submatrix formed by the last a rows and columns (resp. by the first b rows 
and columns) of g. With these definitions, it follows immediately that 

(9 A 9' 1 )(a,b) = g(>a.)A( a ,b)g~[< b y 

This yields the following equalities of block matrices 

(gAg-Y = {P^gAg- 1 )^))^ = ((gP 1 . J (A)g- 1 ) {at , b]) ) l . J 
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- (5(>a i )^j(-4)(a l ,fc 3 )3(<6 J ) — (<>i ,j 9{> ai ) ) i ,j A p (S 2 j g(< b . ) 

and thus 

L^igAg- 1 ) =det((.gA 5 - 1 ) p ) =l[dct(g { > az) )l[det(g { < bi) )- 1 D p (A). 



□ 

With the aid of these semiinvariants, we can see that the entries of the normal 
form H associated to a matrix A fulfilling the conditions of Corollary |5 . 2 1 depend 
polynomially on A, by describing them as the value of a special semiinvariant 
D p : 

Lemma 5.4. For i and j such that 1 < j ' < n — 2 and j + 2 < i < n, consider 
the datum P as above defined by a\ = j — 1, 02 = i, b% = j, 62 = i — 1, 



P 1A (x) = x n -l +1 , P h2 (x) = 0, P 2 Ax) = x, P 2>2 {x) = 



matrix H in the form of Corollary 



5.2 



Then, for a 



we have D (H) = H 



Proof. By a direct calculation, the matrix H p consists of the blocks 

/ 1 00 

■II 1 '- a ... ; I • {H P )i, 2 -0. 



V 



1 



(H P ) 2 ,i — {H p ) 2 , 2 



V 







1 / 



Thus, the matrix H p is lower triangular, all diagonal entries being 1 except the 
(j, j)-entry, which equals Hi j. □ 

It seems likely that the semiinvariants D p generate the ring of all semiinvariants 
at least for a certain cone of weights. The generic normal form of Corollary |5.2| 
allows to find identities between the D p by evaluation on matrices H in normal 
form. 
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Figure 1: The Auslander-Reiten quiver of rep fc (<2, I) 
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